Random Geometric Series 



E. Ben-Nairn 
Theoretical Division and Center for Nonlinear Studies, 
Los Alamos National Laboratory, Los Alamos, New Mexico 87545, 



USA 



P. L. Krapivsky 
Center for Polymer Studies and Department of Physics, 
Boston University, Boston, Massachusetts 02215, USA 

Integer sequences where each element is determined by a previous randomly chosen element are 
investigated analytically. In particular, the random geometric series Xn — 2xp with < p < n — 1 
is studied. At large n, the moments grow algebraically, (x^) ~ n'''"' with f3{s) = 2' — 1, while the 
typical behavior is Xn ~ n'°^. The probability distribution is obtained explicitly in terms of the 
Stirling numbers of the first kind and it approaches a log-normal distribution asymptotically. 
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I. INTRODUCTION 



II. RANDOM MULTIPLICATIVE SERIES 



Integer sequences are ubiquitous in pure and applied 
mathematics, physics, and computer science Q. While 
traditional integer sequences are deterministic, there is a 
growing interest in stochastic counterparts of fundamen- 
tal sequences and their relevance to disordered or random 
systems. For example, the random Fibonacci sequence 
Xn = Xn~i ± Xn-2 [1, 1^ has links with various topics 
in condensed matter physics, dynamical systems, prod- 
ucts of random matrices, etc. (see e.g. |EIE0ISIS^3)- 

Random integer sequences are conceptually simple, yet 
they exhibit a complex phenomenology resulting from 
the memory generated by the stochastic recursion law. 
For the random Fibonacci sequence, the typical behav- 
ior is Xn ~ e'^" with the intriguing Lyapunov exponent 
A — 0.12397559; furthermore, the distribution of the ra- 
tio Xn/Xn-i has singularities at every rational value 0.3 
and the model exhibits a remarkably intricate spectrum 
[To|. Also, the typical growth is different than the aver- 
age growth as characterized by the moments (x^). 

Another form of randomness in which an element in 
the series depends on two previous elements, at least one 
of which is chosen randomly, was introduce recently . 
For example, the stochastic Fibonacci-like series defined 
recursively by the rule x„ = Xn-i + Xp with p randomly 
chosen between and n — 1, exhibits the typical growth 
Xn ~ exjp(X^/n) with the (numerically calculated) Lya- 
punov exponent A — 1.889. The moments exhibit multi- 
scaling [llL [ij and the probability distribution becomes 
log-normal asymptotically. Small variations in the recur- 
rence rule can lead to substantial changes in the sequence 
characteristics — the growth law may be algebraic, log- 
normal, or exponential and the distribution may or may 
not exhibit multiscaling of the moments. In this article, 
we show that much of this phenomenology is captured by 
even simpler stochastic series, for which a more detailed 
analytical treatment is feasible. 



We consider recursively defined series where an element 
is determined by a single previously chosen element. A 
natural starting point is the random geometric series 



(1) 



when n > 1 and = 1 . The index p is chosen randomly 
between and n — 1 at each step. The first element is 
xq = 1. For example, for n < 2, there are two, equally 
probable sequences: Xn — 1,2,2 or 1, 2, 4. The series may 
not necessarily be monotonic. 



A. The Moments 

The moments {x'^) can be obtained analytically. They 
obey the recursion relation 



n-l 

n ^-^ 

p=0 



(2) 



for n > 1, with (xq) = 1. This recursion is solved using 
the generating function Af(s,z) = X)^^o(^n) "^^^ 
recursion relation |(5J) leads to the ordinary differential 
equation ^ = subject to the boundary condition 

M(s,0) = 1. Expanding the solution 

Af(s,z) = (1 - z)-'^' 

in powers of z gives the moments 

r(n + 2^) 
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The first and the second moment are given by simple 
polynomials 



1, 
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Generally, there is a series of special values of s for which 
the moments are polynomial in n. For 2^ = k with k 
being an integer, the moments are 

/^lnfc/ln2N _ (» + 1) + 2) ■ ■ ■ (n + fc - 1) 

^" '~ (fc-1)! • 

Asymptotically, all moments grow algebraically 

{xt,)^A{s)n^(^) (7) 

with fi{s) = 2^* - 1 and A{s) = l/r(2'*). Therefore, the 
moments exhibit a multiscaling behavior characterized 
by the nonlinear spectrum of exponents /3(s). 



Taking the logarithmic derivative gives the average 



aw 



=1 — H„ 



(14) 



in terms of the harmonic numbers iJ„ = Sj=i J- Using 
the large n asymptotics of the harmonic numbers [13| . 
we conclude that the average grows logarithmically 



= In 71 + 7 + — 
2n 



(15) 



The second derivative lnS'„(u')|^=i similarly gives 
(TO„(m„ — 1)). The variance, w^^ — (m,'^) ~ (rrin)'^ , follows 



B. The Probability Distribution 

The probability distribution of the random variable Xn 
and its typical behavior are obtained by considering a 
closely related random sequence. Since the spectrum of 
possible values for x„ is 2™ with integer m > 0, we study 
the variable m„ = log2 Xn ■ The corresponding random 
additive series obeys the recursion relation 



1 



(8) 



with mo = and a randomly chosen < p < n ~ 1. 
Generally, 1 < m„ < n for n > 1. The probability 
distribution Pn,m — Prob(a;„ — 2™) satisfies 



w: 



(16) 



Here, = ELi -=2 are the second-order harmonic 

numbers. Asymptotically, the variance grows logarith- 
mically 



= Inn 



6 2n 



(17) 



The leading asymptotic behavior of the distribution 
can be evaluated as well. Using properties of the Stirling 
numbers, the distribution for small m reads 



P. 



^ n— 1 

— / Pl.rn-1 



(9) 



for n > 1 and Po.m — Sm.o- From this recursion, one read- 
ily obtains 7iP„^„i - (n - l)P„_i,„i = Pn-i,rn-i, thereby 
recasting into 



„ rt — 1 „ 
p — p 

^ n.m n- 



1 



" Pji — 1 , m — 1 



(10) 



To tackle this recursion it is convenient to eliminate the 
denominator. The modified distribution Gn,m = n-lPn^m 
satisfies the recursion 



(11) 



with Go.m = Sm,Q- The very same recurren ce g enerates 
[^] , the Stirling numbers of the first kind [13 ■ These 
numbers are closely related to the binomial coefficients 
and appear in numerous applications [T3 . ITsl IT^ . 

Thus Gn,m = [^] , and the probability distribution is 
expressed in terms of these special numbers as follows: 



P, 



(12) 



Moments of the variable m„ are obtained from the gen- 
erating function |17| satisfied by the Stirling numbers of 
the first kind [l3l 
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These exact results reflect that the distribution is Pois- 
sonian for sufficiently small m: 



p 



1 (Inn)" 



n (m — 1)! 



(19) 



The Poissonian form corresponds to the small-m tail 
of the distribution. To obtain the distribution for typi- 
cal, rather than extremal, values of m, we consider the 
continuum limit of the recursion relation l|l(J|l where the 
distribution satisfies 



dP dP _1 d'^P 
dn dm 2 dm? 



(20) 



The change of variables n t — J" dn' /n' trans- 
forms (|20|l into the standard diffusion-convection equa- 
tion whose solution admits a Gaussian form 



1 



exp 



(to„ - (to„))^ 
2wl 



(21) 



As m„ = lna;„/ln2, the distribution of x„ is therefore 
log-normal. Moreover, the variance of the random vari- 
able InXn is simply (In 2)^ Inn. 



Both the Poissonian and the Gaussian behaviors follow 
from the more general asymptotic form of Pn,m 



p 



1 



(Inn)™ 
r(m/ Inn) n ■ ml 



(22) 



that holds when m ^ oo and 7i — )■ oo with the ratio 
m/lnn being finite. Indeed, using the asymptotic rela- 
tion T{x) as X ^ one recovers ()19(l : the peak 
of the distribution (|22|l is at to = Inn and expansion 
in the vicinity of this peak recovers H21|l . We term the 
distribution 1)22(1 the modified Poissonian distribution. 

To derive we use (O-lO and the Cauchy the- 
orem to express Pn,m as an integral 



1 
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dw w{w + 1) . . . (ui + n — 1) 



(23) 



over an arbitrary simple closed contour enclosing the ori- 
gin in the complex w plane. When n oo, the contour 
integral is easily computed by applying the steepest de- 
scent method. The saddle point is determined from 



1 



(24) 



Asymptotically, ~ to/ Inn. We now deform the inte- 
gration contour to the contour of steepest descent that 
runs through the saddle point along the imaginary axis 
(in the complex w plane). Writing w — w^:{l + iy) and 
taking into account that the dominant contribution is 
gathered near y = 0, we obtain 



ZTT 



w* (w* -I- 1) . . . (w, -f n — 1) 
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w™ • n! 

T{w,+l) 



dye 



V2^ w™r(n + l)r(it;*) 



-.w^ —1 



\J2-Kvn w™ r(w*) 

where we used two properties of the gamma function 
— the difference equation r(x + 1) = xY(x) and the 
asymptotic relation '^^^(x) ^ 2;° as x — s- oo. Inserting 
w^, ~ to/ Inn and using the Stirling formula leads to (|22|l . 
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FIG. 1: A single realization of the random geometric series 
(bullets) versus the typical behavior 12511 . shown using a line. 
For clarity, only a small fraction of the series elements are 
displayed. 



via Xn exp(Alnn) is obtained from the moment spec- 
trum using A = lims_>o s~^/3(s). However, the typical 
behavior H25|) and the asymptotic distribution (|21|l do 
not yield the moments as they imply the quadratic mo- 
ment spectrum sin 2 -I- i(sln2)^, equal to the first two 
terms in the Taylor expansion of /?(s). 

There are large fluctuations between successive ele- 
ments in a given series and large series-to-series varia- 
tions. The typical behavior is eventually approached but 
very slowly, as illustrated in Fig. 1. 

Let us compare random geometric series with random 
Fibonacci-like series. Overall, the behavior is in line 
with the behavior found for the 

with 0<p<n — 1. In both cases, the distribution 
of Xn is log-normal and the moments exhibit multiscal- 
ing [ij. In the present case, it is possible to find the 
Lyapunov exponent. However, the behavior is unlike the 
one found for the random sequence Xn = Xp -\- Xq with 
O^P,q^n — 1 despite the fact that in both cases the 
average is (xn) = n + 1. The average characterizes all 
the moments and the distribution approaches an ordi- 
nary scahng from P„(a;) n~^^{xn~^) [Tll |. 



C. The Typical Behavior 

The asymptotic distribution H21|l and the growth law 
l)15|l lead to the typical behavior 

2;„~Cn'"2 (25) 

with C = 2^ 9S 1.491967 and 7 ^ 0.577215 the Eu- 
ler's constant. Since asymptotically, lna:„ — > (lna;„), the 
typical behavior H25|) emerges from the s limit of 
the properly modified moments (x^)^/" in Eq. Q. In 
other words, the Lyapunov exponent A — In 2, defined 



D. Extremal Statistics 

The span of the additive random sequence, i.e. the 
set of all possible values of to, provides an additional 
statistical characterization. In every realization, this set 
contains no gaps, so the span is equivalent to the largest 
sequence element M„. Thus, the span is directly related 
to extremal characteristics of the sequence. To find how 
Mn grow with n, it is necessary to consider the large m 
tail of the probability distribution outside the Gaussian 
region. The modified Poissonian distribution 122|) sug- 
gests that Mn '--^ Inn. 
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FIG. 2: The maximal element in the series. The average 
{M„), obtained from 100 independent realizations of the ran- 
dom additive series (bullets) is compared with the heuristic 
estimate (I28II . shown using a line of slope e. 



We obtain the growth of the maximal element in the 
series heuristically using the extreme value criterion 



n'=Mn m'=M„ 



(26) 



Since the the distribution Pn,m quickly diminishes with 
m in the tail region, this extreme statistics criterion be- 
comes Yln'=M Pn',M,i ^ 1, and as M„ ^ n, one has 



.M„ 



1. 



(27) 



Combining this criterion with the distribution H22|) and 
using the Stirling formula, we arrive to the following 
asymptotic growth of the maximal value 



;ln7 



Numerical simulations are in good agreement with this 
estimate (Fig. 2). A more rigorous derivation including 
the leading correction is given in Appendix A. 

This growth is ultimately connected with the frequency 
by which the largest element in the sequence occurs. At 
the Tith step, the maximal value Af„ is augmented by one 
with probability h/n with h the frequency by which the 
largest element occurs. Thus, (Af„) = (7\f„_i) + -^. This 
leads to the growth law (Af„) ~ {h) Inn . The frequency 
/i is a random variable that in principle depends on n yet 
it has a stationary distribution p{h) in the large n limit. 
The growth law (|28|l implies {h) = ^ hp{h) — e. 



scribe two examples. In both cases we consider the vari- 
able m„ directly. 



A. Random Random Walk 

In the random geometric series, the previous element is 
chosen randomly while the recursive rule is deterministic. 
We thus consider the stochastic recursion relation 



nip ± 1 



(29) 



with Too = and a randomly chosen 0<p<n~loii the 
n*'' step. We assume that both signs in (^5)1 are taken 
with equal probability. We term the sequence generated 
by H29|) the random random walk. 

The moments can be obtained recursively, as in the 
random geometric series and we merely quote the results. 
The first moment vanishes, (to„) = 0, and the variance 
is given by the harmonic numbers 



(30) 



The asymptotic behavior is therefore w'^ ~ Inn. 

The probability P„_m that the walk is at position m at 
the n*^ step obeys 

n — 1 1 
2n 2n 

(31) 

Taking the continuum limit, we find that the distribution 
satisfies — |^ . This diffusion equation shows that 
the distribution is Gaussian 



P. 



1 



V^7 



: exp 



m 

2^ 



(32) 



Therefore, all moments are characterized by the variance: 
,2fe\ ^ — l)!!(lnn)'^. The random random walk 



TO„ 



(28) spreads very slowly with the typical spread 



(33) 



Hence, the first passage time, the time to reach a site of 
distance m from the origin grows as exp(TO^). What re- 
mains an open question is whether the distribution Pn,m 
can be obtained in a closed form from the generating 
function E„,m ^""f^"^",™ = (1 - z)-'"('"+i). In terms 
of the variable Xn = 2™" , the growth is slower than any 
power law, Xn ~ exp(ln 2%/lnn). 



B. Two Dimensions 



III. GENERALIZATIONS 

There are a number of natural generalizations of the 
stochastic sequences and ©• Below, we briefly de- 



Thus far, we considered only one-dimensional se- 
quences. In physical systems, it is generally believed that 
disorder, no matter how small, is always relevant in two- 
dimensions 0,0|- However, disordered two-dimensional 
systems are typically untreatable analytically. 
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We consider a natural generalization of (O to a two- 
dimensional square lattice. Starting from mo — 1, where 
= (0, 0) is the site at the origin, the values at further 
sites are determined recursively according to 



1TLn = nir 



1 



(34) 



Here p = {pi,P2) is chosen equiprobably among lattice 
sites that are closer to the origin than n, i.e. |p| < |n|;. 
We choose the "manhattan distance" from the origin 
|n| = I'T-il + |"2| as the measure of distance. 

The probability distribution depends only on the norm 
n — |n|, so we keep the notation Pn,m- For the norm 
n = |n| = |ni I + |n2 1, there are 4n lattice sites a distance n 
from the origin, 1+4+. . .-|-4(n— 1) = l + 2n(n— 1) lattice 
sites which are a distance < n ~ 1 from the origin. The 
probability distribution satisfies the recursion relation 



p = 

n..m. 



1 - 



4(n - 1) 



4(n 



2n(n 
1) 



Pn 



(35) 



1 + 2n{n - 1) 



P, 



n — 1 , m — 1 



for n > 2 with Po,m = ^m,o and Pi^^ = Sm,i- 

In analogy with the one-dimensional case, we write the 
distribution in the form 



P. 



1 



^(2 



(36) 



^nln the two- 



with n„ = n"=i[l + 2j(j - 1)] and Ch 
dimensional analogs of the Stirling numbers of the first 
kind. These non-negative integer numbers obey the fun- 
damental recursion relation 



G 



(2) 



[1 + 2n{n ^ l)]Gifl, + 4nG. 



(37) 



for n > 2 and G 



(2) 
0,m 



S„ 



The corre- 



sponding generating function is 



w = w 



'[[[l + 2{j-l){j~2 + 2w)] (38) 



i=i 



for rt > 1. Using this generating function, the average 
and the variance are 



4(J - 1) 



^ 1 + 2j{j - 1) 



4(j - 1) 
+ 2j(i- 



(39) 



i=i 



4(j - 1) 
1 + 2j(j - 1) 



The leading asymptotic behaviors are (m„) ~ 21nn and 
~ 2 Inn. In the continuum limit, the distribution 
obeys the diffusion-convection equation that now has the 
form + 24^ — -f-?-. Asymptotically, the distribu- 

an am om^ j r- j 7 

tion is Gaussian as in the one-dimensional case 1)211) with 
the average and the variance merely modified by the fac- 
tor 2. One can also show, by generalizing the moment 
recursion relation |2Jl, that the spectrum is also modified 
by the same factor: /3(s) = 2(2" — 1). 



IV. SUMMARY 

In summary, we considered random sequences where an 
element depends on a previous randomly chosen element 
and have shown that they exhibit a similar phenomenol- 
ogy as sequences that involve dependence on a few pre- 
vious elements. The typical behavior and the moment 
behavior provide a statistical characterization of the se- 
quence. The growth laws depend sensitively on details of 
the recurrence relations. 

We obtained a number of exact and asymptotically ex- 
act results for the probability distribution and its mo- 
ments. For the random geometric series, the sequence 
growth is algebraic. The moments exhibit multi-scaling 
asymptotic behavior and also contain information regard- 
ing the typical behavior. Asymptotically, the probabil- 
ity distribution becomes log-normal but it does not fully 
characterize the actual moment behavior. 

There are additional interesting questions that can be 
asked for this family of random series including the like- 
lihood of monotonically increasing sequences, growth of 
correlations between two different elements in the same 
sequence, and statistics of the number of distinct ele- 
ments in a given sequence. 
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APPENDIX A: DERIVATION OF EQ. (|28|l 

Substituting 122|l into the criterion 
Sra'=M Pn' ,Mn ~ 1 and replacing the summation 
by integration yields 



1 



,M„ 



n'=M„ 



dn' (Inn') 



/\Af„ 



{Mn)\J n' r(M„/lnn') 

(Inny^ 
(Mn + 1)! 



1. 



(Al) 



Taking the logarithm of I|A1|I and using the Stirling for- 
mula, we obtain an implicit relation for the maximal el- 
ement 



In Af„ — In Inn. 



In n y 2 

This yields the leading correction to Eq. 



M„ — *■ e In n — — In In n 



(A2) 



(A3) 



Mn is of course a random variable and l)A3)l represents 
its average (M„). We anticipate that fluctuations in A/„ 
remain finite as n — > oo. 
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